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SPECIAL NOTES 


1. API PUBLICATIONS NECESSARILY ADDRESS PROBLEMS OF A GENERAL 
NATURE, WITH RESPECT TO PARTICULAR CIRCUMSTANCES, LOCAL, STATE, 
AND FEDERAL LAWS AND REGULATIONS SHOULD BE REVIEWED. 


2. APIIS NOT UNDERTAKING TO MEET THE DUTIES OF EMPLOYERS, MANU- 
FACTURERS, OR SUPPLIERS TO WARN AND PROPERLY TRAIN AND EQUIP 
THEIR EMPLOYEES, AND OTHERS EXPOSED, CONCERNING HEALTH AND 
SAFETY RISKS AND PRECAUTIONS, NOR UNDERTAKING THEIR OBLIGATIONS 
UNDER LOCAL, STATE, OR FEDERAL LAWS. 


3. INFORMATION CONCERNING SAFETY AND HEALTH RISKS AND PROPER 
PRECAUTIONS WITH RESPECT TO PARTICULAR MATERIALS AND CONDI- 
TIONS SHOULD BE OBTAINED FROM THE EMPLOYER, THE MANUFACTURER 
OR SUPPLIER OF THAT MATERIAL, OR THE MATERIAL SAFETY DATA SHEET. 


4, NOTHING CONTAINED IN ANY API PUBLICATION IS TO BE CONSTRUED AS 
GRANTING ANY RIGHT, BY IMPLICATION OR OTHERWISE, FOR THE MANU- 
FACTURE, SALE, OR USE OF ANY METHOD, APPARATUS, OR PRODUCT COV- 
ERED BY LETTERS PATENT. NEITHER SHOULD ANYTHING CONTAINED IN 
THE PUBLICATION BE CONSTRUED AS INSURING ANYONE AGAINST LIABIL- 
ITY FOR INFRINGEMENT OF LETTERS PATENT. 


5. GENERALLY, API STANDARDS ARE REVIEWED AND REVISED, REAF- 
FIRMED, OR WITHDRAWN AT LEAST EVERY FIVE YEARS. SOMETIMES A ONE- 
TIME EXTENSION OF UP TO TWO YEARS WILL BE ADDED TO THIS REVIEW 
CYCLE. THIS PUBLICATION WILL NO LONGER BE IN EFFECT FIVE YEARS AF- 
TER ITS PUBLICATION DATE AS AN OPERATIVE API STANDARD OR, WHERE 
AN EXTENSION HAS BEEN GRANTED, UPON REPUBLICATION. STATUS OF THE 
PUBLICATION CAN BE ASCERTAINED FROM THE API AUTHORING DEPART- 
MENT [TELEPHONE (202) 682-8000]. A CATALOG OF API PUBLICATIONS AND 
MATERIALS IS PUBLISHED ANNUALLY AND UPDATED QUARTERLY BY API, 
1220 L STREET, N.W., WASHINGTON, D.C. 20005. 
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FOREWORD 


API publications may be used by anyone desiring to do so. Every effort has been made 
by the Institute to assure the accuracy and reliability of the data contained in them; however, 
the Institute makes no representation, warranty, or guarantee in connection with this pub- 
lication and hereby expressly disclaims any liability or responsibility for loss or damage re- 
sulting from its use or for the violation of any federal, state, or municipal regulation with 
which this publication may conflict. 

Suggested revisions are invited and should be submitted to Measurement Coordination, 
Industry Services Department, American Petroleum Institute, 1220 L Street, N.W., Wash- 
ington, D.C. 20005. 
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Chapter 13—Statistical Aspects of Measuring and Sampling 


SECTION 2—METHODS OF EVALUATING METER PROVING DATA 


13.2.0 


Minimizing systematic and random errors, estimating re- 
maining errors, and informing affected parties of errors are 
becoming increasingly important to the petroleum industry. A 
consistent basis of estimating the size and significance of er- 
rors is essential for communications between affected parties. 
A consistent basis of estimating and controlling errors can 
help to avoid disputes and dispel delusions on the accuracy of 
activities and equipment related to meter proving operations. 

A wide range of designs, equipment, and service operat- 
ing conditions is experienced in meter proving operations. 
Because of these variations, it is impractical to establish 
fixed procedures for maintenance, calibration, and proving 
activities for all installations. 

Meter proving factors (meter factors) are normally moni- 
tored to detect trends or sudden deviations as indications of 
when to perform maintenance and calibration of measure- 
ment equipment. 

The purpose of this chapter is to provide procedures for 
recording, analyzing, and controlling variations in meter fac- 
tors so that random uncertainties are understood and consistent 
with the objectives of parties affected by the measurement op- 
erations. Limits on meter factor variations are left to the agree- 
ment of parties affected by the measurement operations. 


Introduction 


13.2.1 


Chapter 13.2 will address procedures for evaluating any 
meter’s performance where meter proving factors are devel- 
oped in accordance with Chapter 12.2. The data in examples 
used in this chapter are intended to be typical of custody 
transfer operations of low-vapor-pressure fluids using dis- 
placement or turbine meters in accordance with Chapters 4, 5, 
and 6 of the Manual of Petroleum Measurement Standards. 
However, the procedures in Chapter 13.2 can be used for non- 
custody transfer metering applications and for custody trans- 
fer metering of high-vapor-pressure and gaseous fluids where 
meter proving data are available. 

Procedures and examples are given for analyzing the ran- 
dom uncertainties associated with meter proving data (see 
note). Procedures and examples are also given for evaluat- 
ing and controlling trends in meter factors with control 
charts and control logs to ensure that meter factor variations 
exhibit a random nature that results in the propagation of a 
lower average uncertainty in measurements with time and 
throughput. 


Scope 


Note: Uncertainty computations are based on procedures given in Chapter 
13.1 of the Manual of Petroleum Measurement Standards. 


Since no single document can cover all of the statistical 
procedures and applications being practiced, procedures 
other than those appearing herein may be used. Alternate sta- 
tistical procedures are not expected to duplicate the compu- 
tational values provided by procedures in this chapter. 
However, alternative procedures should achieve the same 
purpose intended by the procedures given herein. When al- 
ternative statistical computational procedures are to be used 
and affect metered quantities, parties directly involved with 
the metering operations should be notified prior to their 
implementation. 

Some of the procedures in Chapter 13.2 are suitable for 
hand calculations and graphs employed by field personnel. 
These procedures are discussed and illustrated in 13.2.5 of 
this chapter. However, the statistical evaluations and control 
charts are generally too rigorous for manual field computa- 
tions, and computers should be employed. The statistical 
procedures in this document may serve as a guide for devel- 
oping software for computer applications. 


13.2.2 Definitions 


The following definitions supplement the definitions 
appearing in Chapter 13.1. 

Action limits are control limits applied to a control chart 
or log to indicate when action is necessary to inspect or 
calibrate equipment and possibly issue a correction ticket. 
Action limits are normally based on 95 percent to 99 per- 
cent confidence levels for statistical uncertainty analyses 
of the group of measurements. 

Control chart is a graphical method for evaluating 
whether meter proving operations are in or out of a state of 
statistical control. 

Control log is a tabular method for evaluating whether 
meter proving operations are in or out of a state of statistical 
control. 

Control chart or log, fixed limit is a control chart or log 
whose control limits are based on adopted fixed values appli- 
cable to the statistical measurements displayed on the log or 
chart. Historically, fixed limits have been used to control the 
limits on meter factor changes. 

Control chart or log, no fixed limit is a control chart or log 
whose control limits are based on the statistical variations of 
measurements displayed on the chart or log. 

Control limits are limits applied to a control chart or log to 
indicate the need for action and/or whether or not data is in 
a state of statistical control. Several control limits can be ap- 
plied to a single control chart or log to determine when var- 
ious levels of action are warranted. ‘lerms used to describe 
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various control limits are “warning,” “action,” and “toler- 
ance” limits. 

Central line is a line on a control chart representing the 
average or standard value of the statistical measure being 
plotted and is the reference line or value from which control 
limits are determined and plotted. 

Central value is the average or standard value of the statis- 
tical measure being logged and is the reference value from 
which control limits are determined. 

Moving series is a cumulative group of data (meter fac- 
tors) whose scope increases as more data become available. 

Rational subgroup is a grouping of measurements chosen 
in such a way that variations within the group and subgroups 
are independent and random in nature. 

A mn is an uninterrupted, consecutive sequence of events 
that are measured cumulatively, such as meter pulses during 
a single trip or round-trip of a displacer in a volumetric meter 
prover. 

Set is a series of runs made under similar and controlled 
conditions. 

A Shewhart control chart consists of control chart proce- 
dures developed by Walter A. Shewhart. The control limits 
are based on empirical and economic considerations for the 
industrial processes evaluated by Shewhart. Control charts 
are generally based on the variation of individual measure- 
ments within +3 times the average standard deviation for 
ali measurements. These charts require rational subgroups. 
The limits do not relate directly to the 99.7 percent uncer- 
tainty bounds for measurements because average standard 
deviations are used. Refer to Appendix C for information 
on Shewhart control chart procedures. 

Tolerance limits are control limits that define the confor- 
mance boundaries for meter factor variation. Tolerance 
boundaries indicate when an audit or technical review of the 
facility design operating variables and/or computations may 
be necessary to determine sources of errors and changes re- 
quired to reduce variations in the meter factors. Tolerance 
limits are normally based on 99 percent or greater confi- 
dence levels. 

Warning limits are control limits applied to a control 
chart or log to indicate when meter proving equipment, op- 
erating conditions, or computations should be checked be- 
cause meter factors are outside preestablished limits. 
Warning limits are normally based on 90 to 95 percent con- 
fidence levels for assessing statistical uncertainty in the 
group of measurements. 


13.2.3. Nomenclature 


The following alphanumeric and algebraic symbols are 
used in Chapter 13.2: 


a_ Estimate of A. 
D — Conversion factor (used to derive s from w). 
G, H,1I, J, K, | Conversion factors for computing control 


L, M,N limits in Shewhart control chart proce- 

dures. The sequence of nomenclature cor- 

responds to A;, A;, B;, B,, D3, D,, E,, and 

E,, respectively, appearing in other pub- 

lished sources on Shewhart control charts. 

k number of sets in a series of measure- 
ments. 
k Average of k sets of measurements. 

MF Meter factor. 

MF Average meter factor. 

Number of repeat measurements in a set. 

Average of n repeated measurements in a 

set. 

s Estimate of standard deviation. 
t Value of Student’s t distribution. 
T(%) Conversion factor used to derive uncer- 
tainty from the standard deviation. 

7(%, nork) Conversion factor for deriving uncertainty 
of individual measurements from the stan- 
dard deviation of a series of muns or sets. 

1(%, ork) Conversion factor for deriving uncertainty 

of the average from the standard deviation 

of a series of runs or sets. 

Range of a set of data. 

Observed value of a variable. 

Observed mean value of a set of data. 

Overall average of the means of individual 

sets. 

2Z(%, n ork) Conversion factor for deriving uncertainty 

of individual measurements from the aver- 

age range of a series of runs or sets. 

Conversion factor for deriving uncertainty 

of the average from the average range of a 

series of runs or sets. 

(%) Denotes the confidence level for conver- 
sion factors for calculating uncertainty 
from standard deviation or range data. 

@ Degrees of freedom, n— 1. 


xe eS 


2%, i or k) 


13.2.4 Referenced Publications 


The most recent editions of the following standards, spec- 
ifications, and publications are cited in this standard: 


ANSI'/ASQC? 
Al Definitions, Symbols, Formulas, and 
Tables for Control Charts 
B1,B2,andB3 Guide for Quality Control Charts, 


Method of Analyzing Data, and Con- 
trolling Quality During Production 


‘American National Standards Institute, 11 West 42nd Street, New York, 


New York 10036. 
American Society of Quality Control, P.O. Box 3005, Milwaukee, 
Wisconsin 53201-9402. 
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API 
Manual of Petroleam Measurement Standards 

Chapter 4, “Proving Systems” 
Chapter 5, “Metering” 
Chapter 6, “Metering Assemblies” 
Chapter 12.2, “Calculation of Liquid 
Petroleum Quantities Measured by Tur- 
bine or Displacement Meters” 
Chapter 13.1, “Statistical Concepts and 
Procedures in Measurement” 


ASTM? 
MNL7 Manual on Presentation of Data and 
Control Chart Analysis 


13.2.5 Meter Factor Logs and Graphs 


A flow meter will vary in response to changes in flow rate, 
mechanical condition of the meter, changes in fluid proper- 
ties, contaminants content of the flowing stream, and the 
amount of paraffin deposits. The control chart provides a 
method of determining whether an adjustment should be ini- 
tiated, the meter should be repaired, or both. 

Fluid properties that directly affect the flow meter’s per- 
formance are viscosity, density (API gravity), and lubricity. 

A flow meter’s performance is represented by its meter 
factor. However, the meter factor also represents changes in 
the performance of the prover, interchange valves, detector 
switches, prover sphere, prover coating, pulse generators, and 
proving counters. Simply stated, the meter factor represents 
the performance of the flow meter and the proving system. 


13.2.5.1 METER FACTOR LOG 


A meter factor log is a table for recording in sequence 
each meter factor and data that affect the meter’s operation. 
A simple example of a meter log is shown in Figure 1. 

The meter factor log facilitates hand or computer compu- 
tation of changes between consecutive meter factors and net 
accumulation of changes from a baseline meter factor. Meter 
factor logs are normally based on fixed values to determine 
when warning, action, or tolerance limits are exceeded. In 
the example in Figure 1, action limits of +0.50 percent from 
the baseline factor are shown for illustration purposes. 


13.2.5.2 METER FACTOR GRAPH 


The data on the meter factor log can also be plotted on a 
graph as shown in Figure 2. Using graphs facilitates the de- 
tection of trends by field operating personnel. The meter 
factors plotted in Figure 2 exhibit a significant trend that 
could result in a systematic error in the custody measure- 
ment quantities. 


3 american Society for Testing and Materials. 1916 Race Sweet. Philadel- 
phia, Pennsylvania 19103-1187. 
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13.2.6 Application of Statistics to Meter 
Proving Data 


13.2.6.1 FIXED LIMITS 


Fixed criteria are normally used for judging the acceptabil- 
ity of meter factor data. Industry practice is for custody trans- 
fer parties to reach agreement on a minimum number of 
proving runs that agree within a maximum range between 
high and low meter proving pulses or meter factors. Custody 
transfer parties also agree on a meter proving interval and de- 
viation limit between consecutive meter factors. Cumulative 
meter factor change for a new or overhauled meter is usually 
given a fixed limit unless fixed time or throughput intervals are 
applied for inspection and maintenance. The deviation limits 
between consecutive meter provings and cumulative meter 
factor changes serve as warning and action limits to operating 
personnel in judging the reliability of the meter proving data 
and the physical condition of the meter and proving systems. 

Fixed limits should be based on the experience of attain- 
able performance of metering systems and the stability of 
operating conditions such as flow rate, pressure, tempera- 
ture, and fluid properties. However, experience-based criteria 
will not always be appropriate for new equipment or operat- 
ing conditions. Statistical methods should be used to develop 
meter proving limits for new installations and applications 
where the suitability of experience-based limits is question- 
able. Statistics can also be used to judge the suitability of 
fixed meter proving ranges and deviation limits. Conversely, 
fixed limits can also be used to judge the suitability of statis- 
tically based limits for metering systems that exhibit broad 
deviations in meter proving data. 


13.2.6.2 EVALUATING TRENDS IN A SINGLE 
SET OF METER PROVING DATA 


Operating changes during and between meter proving 
runs should be minimized so that variations in meter pulses 
or meter factors are primarily due to the performance of the 
meter and proving system. Meter factors or meter pulses for 
each run should be evaluated in sequence to determine if 
there is a time related trend due to changing operational pa- 
rameters or malfunctioning equipment. The set of meter fac- 
tors listed for the example in Table 1 illustrates a sequential 
bias and should not be used for correcting the meter’s output 
unless it can be determined that the midpoint of the set rep- 
resents the midpoint of operating conditions of the meter. 

Trending analyses may not be practical or cost effective 
every time a meter factor is determined. It is presented for 
periodically analyzing meter proving data to determine that 
proving conditions are consistent with actual operations. 

The set of meter factors shown in Table | are graphed in 
sequence in Figure 3. The meter factors show a trend that 
would be undetectable if only two meter proving runs were 
made and used for the meter factor. 
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XYZ Company 
METER FACTOR LOGGING SHEET 


Location: Anywhere Meter Make/Style: Generic PD Flow Range: Min: 85 Max: 850 BPH 


Serial #: G123456 Temp Comp: Yes/No atc Action Limit: 40.50% 


Product: Crude ProverType: Bi-Dir Eall Prover Serial #: c12345 


Sequence Meter | Proving | Meter Gravity | Flow | % Deviation | % Deviation 
No. Date Factor | Report # | Temp. sone API@ 60°F} Rate | Last Proving 
1-2-87| 1.0005 Initial mmitial | Baseline 
factor 


4 


% 
~ 
B 
° 
a 
Bb 
Oo 
I! 
° 
oO 
iS} 
+ 
° 
a 
~~ 


meter 
11-6-87] 1.0010 Baseline 
factor 


Figure 1—Example of a Meter Factor Log 
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1.0060 


1.0050 


1.0040 


1.0030 


1.0020 


1.0010 


Meter Factor 


1.0000 


0.9990 


0.9980 


0.9970 


0.9960 


SS. 


Upper deviation limits 


Baseline SS SSS SS 


— Ss———— 


Lower deviation limits 


Meter Factor Sequence 


Figure 2—Example of a Meter Factor Graph 


Further examination of the meter factor data yields the ad- 
ditional information in Table 2. 

Historical data on operating flow rates for the meter in 
this example are summarized in Table 3 and illustrated in 
Figure 4. 

The cumulative distribution of operating flow rates for 
the meter in question is shown in Figure 4. Since the meter 
operates between 280 and 320 barrels per hour 95 percent 
of the time, meter proving factors outside this range should 
normally be excluded unless performance curves and oper- 
ating history establish the linearity of the meter for the me- 
tered fluids over the range of operating flow rates. In this 
example, meter factors one through seven should be ex- 
cluded from the meter factor determination. The average 


Table 1—Example: Sequential Set of Meter Factors 


Sequence Meter Factor, MF 


1.0006 
1.0008 
1.0012 
1.0010 
10011 
1.0015 
1.0014 
1.0016 
1.0021 
1.0020 


Swowowawbs wr 


_ 


meter factor for the set should be based on runs eight, 
nine, and ten if only three runs are required to meet the 
company’s meter proving procedure. If more meter prov- 
ing factors are required, additional provings should be 
made within the normal operating flow range of the meter. 
If three more meter provings are conducted and added to 
meter factors eight, nine, and ten, the modified meter prov- 
ing set becomes that shown in Table 4. 


13.2.6.3 STATISTICAL ANALYSES OF A SINGLE 
SET OF METER PROVING DATA 


Fixed limits are usually applied to determine the accept- 
ability of meter proving data. Statistical procedures can be 
used to evaluate the uncertainty of various meter proving 
criteria consisting of varying deviation limits and time in- 
tervals. A statistically based uncertainty criterion can also 
be used to determine the acceptability of a set of meter 
proving data. 

The computed average or arithmetic mean of a single set 
of values is calculated as follows: 


Gate Cages? cto) (1) 
n 


For the set of meter proving runs in Table 4, the average 
meter factor is determined as follows: 
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Table 2— Example: Meter Proving Operating Parameters 


Meter Factor, 
Sequence MF 


1,0006 
1.0008 
1.0012 
1.0010 
1.0011 
1.0015 
1.0014 
1.0016 
1.0021 
1.0020 


SCwwr aA wARWHe 


ey 


Note: bph = barrels per hour. 


MF = 5 (1.0016 + 1.0021 + 1,0020 + 1.0018 
+ 1.0021 + 1.0020) 


= 1.0019 


The standard deviation of a single set of meter proving 
runs is determined with the following equation: 


(2) 


Table 5 shows the calculation of the standard deviation for 
the modified meter proving set in Table 4. 

Another statistical quantity used to evaluate a set of meter 
proving runs is range, which is determined as follows: 


w(x) = largest value — smallest value (3) 


For the data in Table 5, the range is calculated using Equa- 
tion 3 as follows: 


w(MF) = 1.0021 - 1.0016 = 0.0005 


The standard deviation for a single set of meter proving 
runs can be estimated from the average range as follows: 


Table 3—Example: Historical Statistical Data on 


Flow Rates 
Historical Cumulative 

Flow Rate Occurrence Occurrence 

(bph) (percent) (percent) 
220 to 230 25 .25 
230 to 240 25 50 
240 to 250 0.5 1 
250 to 260 1 2 
260 to 270 1 3 
270 to 280 2 5 
280 to 290 10 15 
290 to 300 40 55 
300 to 310 30 85 
310 to 320 15 100 


Note: bph = barrels per hour. 
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Flow Rate Temperature 
(bph) CF) 
200 46 
205 47 
215 49 
230 31 
250 $2 
255 53 
275 S7 
290 58 
305 59 
310 60 


Din)" Dee) ae 


Values of the range to standard deviation conversion fac- 
tors are given in Table 6. 


For the set of meter factors in Table 4, the standard deviation 
can be estimated from its range and Equation 4 as follows: 


0.0005 
D6) 
0.0005 
2.534 
= 0.0002 
The standard deviation of the average of a single set of 
meter proving runs is estimated as follows: 
z) - 3) 
six} = —= (5) 
@ - © 
For the example in Table 5, the standard deviation of the 
average of a set of meter proving runs is estimated as follows: 


0.0002 


v6 
0.0001 


For the example given in Table 5, both the calculated and 
estimated standard deviations are the same within the number 
of significant digits for computations. This is a coincidence 
because range conversion factors in Table 6 are primarily for 


s(MF) 


(MF) = 


Table 4—Example: Modified Meter Proving Set 


Meter Factor, Flow Rate Temperature 
Sequence MF (bph) (°F) 
8 1.0016 290 58 
9 1.0021 305 59 
10 1.0020 310 60 
11 1.0018 305 60 
12 1.0021 310 61 
13 1.0020 310 61 


Note: bph = barrels per hour. 
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1.0020 
8 
8 

14,0010 
g 
a 
= 

1.0000 


Meter Proving Run Sequence 


Figure 3—Meter Factors for Example 


Cumulative Occurrence (percent) 


= Flow Rate (bph) 


Figure 4—Cumulative Distribution of Flow Rates 
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Table 5—Standard Deviation Calculation 


Meter Factor, =r = 

Sequence MF MF —MF (MF — MFY* 
8 1.0016 0.0003 0.00000009 

9 1.0021 0.0002 0.00000004 
10 1.0020 0.0001 0.00000001 
11 1.0018 -0.0001 0.00000001 
12 1.0021 0.0002 0.00000004 
13 1.0020 0.0001 0.00000001 
MF = 1.0019 0.00000020 


s(x) = (Jee oovea0y = 0.0002 


use with average range (w) from a series of measured values. 
In this example, only one range value is given. 

In evaluating the statistical variation of a set of values, the 
range, w, is an easier quantity to use than the standard devi- 
ation calculated in accordance with Equation 2, especially 
for hand calculations. However, standard deviation is gener- 
ally a more suitable indicator of the statistical variation of a 
set of values from its mean. 


13.2.6.4 UNCERTAINTY ANALYSES OF A 
SINGLE SET OF METER PROVING DATA 


The random uncertainty of individual measurements in a 
set of data in relation to the true mean is the product of the 
standard deviation and statistical factors to convert standard 
deviation to uncertainty. The uncertainty of the individual 
measurements in a set is expressed as follows: 


a(x) = [T(%)]s@)] (6) 


For large sets (greater than 25) of independent random 
measurements, statistical variations in the data usually fol- 
low a normal (Gaussian) distribution. Standard deviation to 
uncertainty conversion factors, 7(%), versus confidence level 
are shown in Table 7. 

For small sets (25 or less), t-distribution values should be 
applied to the standard deviation to estimate uncertainty. The 
t-distribution values to replace 7(%) in Equation 6 are given 
in Table 8 for confidence levels of 90 percent, 95 percent, 99 
percent, and 99.5 percent. 

In this document, the degrees of freedom (¢) associated 
with the Student r functions are taken as n— 1 or kK— 1. To 
avoid confusion between n or & and degrees of freedom, the 
following term is defined and used in place of the Student r 
functions: 


T(%, n or k) = (%, @) (7) 


The random uncertainty of individual measurements in a 
small set is estimated as follows: 


a(x) = |7(%, n)][s(x)| (8) 


Table 6—Range to Standard Deviation Conversion 
Factors 


Range to Standard 
Number of Values Deviation Conversion Factor 
nork D(n) or D(k) 
1.128 
1.693 
2.059 
2.326 


2 

3 

4 

5 

6 2.534 

7 2.704 

8 2.847 

9 2.970 
10 3.078 
1] 3.173 
12 3.258 
13 3.336 
14 3.407 
15 3.472 
16 
17 
18 
19 
20 


3.532 
3.588 
3.640 
3.689 
3.735 


21 3.778 
22 3.819 
23 3.858 
24 3.895 
25 3.931 


The random uncertainty of individual means in & sets of 
data is estimated as follows: 


a(x) = [7(%, &)]|s(x)] (9) 

For applications of statistics to custody measurement, the 
95 percent confidence level is traditionally used for analyz- 
ing and reporting uncertainties in measured values. However, 
other confidence levels can be used as appropriate for spe- 
cific measurements. 

For measurements that are known to be random and are 
frequently repeated, the average value can be propagated to 
a lower value of uncertainty. Confidence levels of 90 per- 
cent or lower are suitable for analyzing and reporting uncer- 
tainties of these individual measurements. For example, the 


Table 7—Uncertainty Conversion Factors for Normal 


Distribution 
Confidence Conversion 
Limit (%)* Factor, T (%) 
50 0.6745 
68.3 1.00 
90 1.645 
95 1.960 
95.5 2.00 
99 2.576 
99.7 3.00 


*Probability that true value falls within limits stated for calculated value. 
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Table 8—t-Distribution Factors for Individual Measurements 


T (%, n or k) Versus Confidence Level 


Number of Sets or 

Measurements, n or k 90% 95% 99% 99.5% 
2 6.314 12.706 63.657 127.320 

3 2.920 4.303 9.925 14.089 

4 2.353 3.182 5.841 TAS3 

2 2.132 2.770 4.604 5.598 

6 2.015 2.571 4.032 4.773 

7 1.943 2.447 3.707 4.317 

8 1.895 2.365 3.499 4.029 

9 1.860 2.306 3.355 3.833 

10 1.833 2.262 3.250 3.690 

11 1.812 2.228 3.169 3.581 

12 1,796 2.201 3.106 3.497 

13 1.782 2.179 3.055 3.428 

14 1.771 2.160 3.012 3,372 

1S 1.761 2.145 2.977 3.326 

16 1.753 2.131 2.947 3.286 

17 1.746 2.120 2.921 3.252 

18 1.740 2.110 2.898 3.222 

19 1.734 2.101 2.878 3.197 

20 1.729 2.093 2.861 3.174 

21 1.725 2.086 2.845 3.153 

22 1.721 2.080 2.831 3.135 

23 1.717 2.074 2,819 3.119 

24 1.714 2.069 2.807 3.104 

20 1711 2.064 2.797 3.091 

7 1.645 1.960 2.576 2.807 

random uncertainty in a single reading of a thermometer _ 2 T(%, n) 7(%, k) 2 
graduated in and read to whole degree units is +0.5°. 7(%. nm OF k) > =e OF VE (12) 
vn 


If a single thermometer is used for five different measure- 
ments, the random error in the average of five measured 
temperatures would be propagated to the following: 


— +0.5° 


a(scale) = 7a 


+0.2° 

If in the above example, the thermometer experienced a 
scale position error of —2°, this error would not be propa- 
gated to a lower average value with multiple measurements. 
Therefore, uncertainties regarding potential scale position er- 
rors should be evaluated at a higher confidence level than 
scale discrimination errors that are random in nature. 

The random uncertainty of the calculated mean in a set of 
n measurements is estimated as follows: 


a(x) = a) (10) 


The random uncertainty of the overall average of calcu- 
lated means in k sets of measurements is estimated as follows: 


(2) = f) z a (11) 


The following term is defined for calculating uncertainties 
of averages using Student t functions and standard deviation. 


Equations 8, 10, and 12 can be combined as follows to cal- 
culate uncertainty for the average in a set of n measurements. 


a(x) = [7(%, a)][s(x)] (13) 


Equations 9, 11, and 12 can be combined as follows to 
calculate uncertainty for the overall average of the means of 


a(x) = [7(%, Rl[s)] (14) 


Values of T(%, n or k) are given in Table 9. 

For the meter proving example shown in Table 4 having 
an average meter factor (MF) of 1.0019 and a standard devi- 
ation of 0.0002, the uncertainty in the calculated average 
meter factor at a 95 percent confidence level using Equation 
13 is as follows: 


o(MF) = [7(95, 6)][s(44F)| 
a(1.0019) = (1.050)(0.0002) 
= +0.0002 


When ranges are used for estimating standard deviation, 
Equations 4 and 8 or 9 can be combined as follows and the 
following term is defined for range to estimated uncertainty 
conversion factors for individual measurements in a set: 
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Table 9—f-Distribution Factors for Averages 


Number of Sets or 
Measurements, 7 or & 90% 
2 4.465 
3 1.686 
4 1.177 
5 0.953 
6 0.823 
7 0.734 
8 0.670 
9 0.620 
10 0.580 
11 0.546 
12 0.518 
13 0.494 
14 0.473 
15 0.455 
16 0.438 
17 0.423 
18 0.410 
19 0.398 
20 0.387 
21 0.376 
22 0.367 
23 0.358 
24 0.350 
25 0.342 
Z(%, nor k) = T(%, n_or k) (15) 
D(n) 
a(x) = [Z(%, n)][w(z)] (16) 
a(x) = [2(%, &)]|w(=)| (17) 


Range to estimated uncertainty conversion factors for in- 
dividual values in a set or individual means in a series of data 
sets are given in Table 10. 

The following term is defined for calculating uncertainties 
of averages using Student ¢ functions, range, and number of 
measurements in a set, n, or number of sets, k. 


Z(%, n) 


Bee aes (18) 
-.  £(%, k) 
2(%, k) = ASL 
ee) Vk 19) 


The uncertainty in the average of a set of measurements 
from the range of the set of measurements can be estimated 


az) = [2(% *)][(2)] “5 


0) = [a BA] 


T (%, or k) Versus Confidence Level 


95% 99% 99.5% 
8.984 45.012 90.029 
2.484 4.730 8.134 
1.591 2.921 3.726 
1.241 2.059 2.504 
1.050 1.646 1.949 
0.925 1.401 1.632 
0.836 1,237 1.424 
0.769 1.118 1,278 
0.715 1,028 1.167 
0.672 0.955 1.080 
0.635 0.897 1.009 
0.604 0.847 0.951 
0.577 0.805 0.901 
0.554 0.769 0.859 
0.533 0.737 0.822 
0.514 0.708 0,789 
0.497 0.683 0.759 
0.482 0.660 0.733 
0.468 0.640 0.710 
0.455 0.621 0.688 
0.443 0.604 0.668 
0.432 0.588 0.650 
0.422 0.573 0.634 
0.413 0.559 0.618 


Range to estimated uncertainty conversion factors for the 
mean in a set of n measurements or for the overall average of 
the means of & sets of data are given in Table 11. 

For the example in Table 4 having a range of 0.0005, the 
uncertainty of the average of the meter factor set at the 95 
percent confidence level is calculated as follows: 


a(MF) = |2(95, 6)|[w(MF)] 
a(1.0019) = (0.420)(0.0005) 
= +0.0002 


The average meter factor for the meter proving set in this 
example, along with the random computational uncertainty, 
is expressed as follows: 


MF = 1.0019 + 0.0002 (95 percent confidence level, 
6 measurements) 


or abbreviated as 
MF = 1.0019 + 0.0002 (95, 6) 


13.2.6.5 UNCERTAINTY ANALYSES OF A 
SERIES OF METER PROVING FACTORS 


The example in Table 12 will be used to illustrate the sta- 
tistical analyses of the random uncertainty in a series of me- 
ter proving factors. 

The following computations cover two methods of esti- 
mating the uncertainty in the overall average of the series of 
ten meter factors. One method uses standard deviations, and 
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Table 10—Range to Estimated Uncertainty Conversion Factors for Individual 


Measurements 
Number of Sets or Z(%, n or k) Versus Confidence Level 

Measurements n or k 90% 95% 99% 99.5% 
2 5.598 11.264 56.433 112.870 
3 1.725 2.542 5.863 8.322 
4 1.143 1.545 2.836 3.620 
5 0.917 1.193 1.871 2.407 
6 0.795 1.015 1.538 1.884 
7 0.719 0.905 1.339 1.597 
8 0.666 0.831 1.209 1.415 
9 0.626 0.776 1.115 1,291 
10 0.596 0.735 1.045 1.199 
il 0.571 0.702 0.991 1.129 
12 0.551 0.676 0.948 1.073 
13 0.534 0.6453 0911 1.028 
14 0.520 0.634 0.880 0.990 
15 0.507 0.618 0.855 0.958 
16 0.496 0.603 0.831 0.930 
17 0.487 0.591 0.812 0.906 
18 0.478 0.580 0.795 0.885 
19 0.470 0.570 0.779 0.864 
20 0.463 0.560 0.764 0.850 
21 0.457 0.553 0.753 0.835 
22 0.451 0.546 0.742 0.821 
23 0.445 0.538 0.730 0.808 
24 0.440 0.532 0.721 0.797 
25 0.435 0.525 0.710 0.786 


Table 11—Range to Estimated Uncertainty Conversion Factors for Averages 


Number of Sets or Z (9, n or k) Versus Confidence Level 


Measurements, n or k 90% 95% 99% 99.5% 
2 3.958 7.965 39.904 79311 

3 0.996 1.467 3,385 4.805 

4 0.572 0.780 1.419 1.810 

5 0.410 0.540 0.885 1.076 

6 0.325 0.420 0.650 0.769 

7 0.271 0.340 0.518 0.604 

8 0.235 0.290 0.434 0.500 

9 0.209 0.260 0.376 0.430 

10 0.188 0.230 0.334 0.379 

a 0.172 0.212 0.301 0.340 

12 0.159 0.195 0.275 0.310 

13 0.148 0.181 0.254 0,285 

14 0.139 0.169 0.236 0.265 

15 0.131 0.160 0.221 0.247 

16 0.124 0.151 0.209 0.232 

17 0.118 0.143 0.197 0.220 

18 0.113 0.137 0.188 0.209 

19 0.108 0.131 0.179 0.198 

20 0.104 0.125 0.171 0.190 

= 21 0.100 0.120 0.164 0.182 
22. 0.096 0.116 0.158 0.175 

23 0.093 0.112 0.152 0.168 

i 24 0.090 0.108 0.147 0.163 
25 0.087 0.105 0.142 0.157 
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Table 12—Example: Statistical Summary of Consecutive Series of Meter Factors 


Individual Runs Individual Set Statistical Data 


Series Sequence Set of Runs Set Average Standard Ranges for Uncertainties of Set 
Number MF MF Deviations, s(MF)* Set, wiMF)? Averages, a(MF)° 
Se eee NR 


1 0.9995 
0.9994 
0.9998 0.99962 0.00020 0.0005 +0.00025 
0.9995 
0.9999 
2 1.0011 
1.0010 1.00120 0.00018 0.0004 +0,00029 
1.0013 
1.0014 
3 0.9992 
0.9994 
0.9990 0.99930 0.00020 0.0006 +0,00021 
0.9993 
0.9993 
0.9996 
4 1.0010 
1.0009 
1.0011 1.00092 0.00015 0.0004 +0.00016 
1.0007 
1.0009 
5 1.0002 
1.0007 
1.0004 1.00048 0,00019 0.0005 +0.00024 
1.0005 
1.0006 
6 0.9992 
0.9989 
0.9991 0.99902 0.00013 0.0003 +0.00016 
0.9989 
0.9990 
7 1.0002 
1.0006 
1,0003 1.00042 0.00013 0.0003 +0.00016 
1.0003 
1,0005 
8 1.0010 
1.0016 
1.0013 1.00128 0.00021 0.0006 +0.00023 
1.0014 
1.0011 
1,0013 
9 1.0002 
1.0000 
0.9998 1.00002 0.00018 0.0004 +0.00022 
0.9999 
1.0002 
10 1.0018 
1.0016 
1.0020 1.00177 0.00019 0.0005 +0.00020 
1.0019 
1.0015 
1.0018 


Overall average, MF 1.00040 
Overall average standard deviation 
of sets, s(MF) 0.00018 
Overall average range of sets, W(MF) 0.00048 


Overall average of the uncertainties 
of individual set averages, a(95, 2) +0.00020 


*See Equation 2. 
See Equation 3. 
See Equation 10. 
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the other method uses ranges of the average meter factors, 
(MF) of the sets. 


a. The standard deviation for the series of ten consecutive 
meter factors (set averages) is 0.00092. The uncertainty in 
the overall average meter factor is as follows: 


a( MF} = [7(95, 10)][s(™F) 
a(1.00040) = (0.715)(0.00092) 
+ 0.00066 


b. The uncertainty in the overall average meter factor (series 
average) can also be estimated with the series range of 
0.0028 of ten-meter factors (set averages) as follows: 


w(MF) = MF(10) ~ MF(6) 
= 1.00177 - 0.99902 
= 0.00275 
a{MF) = [z(95, 10)]| (MF) 
a(1.00040) = (0.230)(0.00275) 
= +0.00063 


The following computations in Items c and d will cover two 
additional methods of estimating the uncertainty in the over- 
all average of the series of ten meter factors using the aver- 
age standard deviation and average range for the sets. 

c. T..¢ uncertainty in the overall average of a serics of metcr 
proving factors can be based on the average standard devia- 
tion for the series of ten meter factors and approximate aver- 
age of five runs in each set of meter factors as follows: 


o(MF) = [7(95, 5)][(r)| 
a(1.00040) = (1.241)(0.00018) 


+ 0.00022 

d. The estimated uncertainty in the average of a series of me- 
ter factor proving factors can be based on the average range 
for each of the ten sets of meter proving factors as follows: 


a(MF) = [z(95, 3)][w(MF)] 
a(1.00040) = (0.54)(0.00048) 


= +0.00026 


The computations of uncertainties in Items c and d are not 
as appropriate as the computations in Items a and b because 
those in c and d do not measure the statistical variations be- 
tween sets of meter proving runs. The values in Items c and d 
approximate the overall average of the uncertainties of indi- 
vidual set averages of +0.00020. The standard deviations and 
ranges within sets of meter proving runs are significantly less 
than the variations between sets. Therefore, the procedures in 
Items a and b are more appropriate for estimating the uncer- 
tainty in the overall average meter factor of 1.00040. The 
overall average meter factor should be stated as follows: 
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MF = 1.00040 + 0.00066 (95 percent confidence 
level, 10 measurements) 


or abbreviated as 


MF = 1.00040 + 0.00066 (95, 10) 


13.2.6.6 UNCERTAINTY ANALYSES OF MOVING 
AVERAGE IN A SERIES OF METER 
FACTORS 


The example in 13.2.6.5 illustrates the analyses of statis- 
tical quantities after completion of a series of ten meter prov- 
ing factors. However, it is often necessary to evaluate a 
moving series of meter factors when few measured values 
are available for statistical analysis shortly after startup of a 
new or overhauled meter as shown in the example in Table 
13, which is based on the example in 13.2.6.5. 

Figure 5 plots the individual meter factors and moving 
overall average meter factors given in Table 13. The moving 
average meter factor exhibits significantly less variation than 
individual meter factors, and this variation decreases as the 
number of values in the moving average increases. 

Figure 6 plots the individual meter factors and random un- 
certainties in the individual meter factors given in Table 13. 
The uncertainty in the moving averages decreases signifi- 
cantly as the number of meter factors in the moving average 
increases. 

Figure 7 shows the moving average of individual meter 
factors and the moving uncertainty of the moving average. 
The moving uncertainty of the moving average decreases 
rapidly for the initial four meter factors in the sequence as 
more data are added. 

Additional examples on calculating uncertainties associ- 
ated with meter proving activities are given in Appendix A. 


13.2.7 Meter Factor Control Charts 
Based on Uncertainty Analyses 


If plotted on a control chart, a series of meter factors ob- 
tained over a period of time under normal operating condi- 
tions will exhibit a band of scatter about an average value. 
The width of this band will depend on the mechanical condi- 
tion of the meter and prover; the uniformity of the fluid; and 
the constancy of the flowing temperature, pressure, and flow. 
Variations in the meter factors are caused by a combination 
of random and systematic influences. In a meter factor, these 
variations are collectively lumped together, and meter factor 
variations are treated as random uncertainty to simplify sta- 
tistical analyses. 

A meter factor control chart clearly illustrates the meter 
factor variations and alerts the operator to changing condi- 
tions that otherwise may not be noticed. 

Control charts are preferably prepared and kept by person- 
nel responsible for proving the meter so that the charts are 
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Table 13—Example: Statistical Summary on Moving Series of 
Average Meter Factors 


Statistical Values of 
Individuals in Moving Sequence 


Series Standard 
Sequence Deviation, 

Number MF * (MFP 

1 0.9996 

2 1.0012 0.0011 

3 0.9993 0.0010 

4 1.0009 0.0009 

5 1.0005 0.0008 

6 0.9990 0.0009 

7 1.0004 0.0008 

8 1.0013 0.0009 

9 1.0000 0.0008 

10 1.0018 0.0009 


*Rounded values from Table 12 


Statistical Values of 


Moving Overall Average 
Uncertainty, at Uncertainty, 

a(MFY MF a(MFy 
+0.0140 1.0004 40.0099 
+0.0043 1.0000 40.0025 
+£0.0029 1.0002 +0.0014 
£0.0022 1.0003 +0.0010 
40.0023 1.0001 +0,0009 
+0.0020 1.0001 +0,0007 
+0.0021 1.0003 +0.0008 
40.0018 1.0002 +0,0006 
0.0020 1.0004 +0.0006 


Standard deviation of prior average meter factors, up to and with respect to current moving average. 


“a(1 to k) = [7(95, A) [s(1 to A)]. 
4a(1t0 & = [T(95, A)[s(1 to A). 


available at the time of proving. Individual control charts for 
each meter shall be maintained since meters vary, as do their 
fluid properties and operating conditions. 

Procedures for developing control charts based on the sta- 
tistical concepts in 13.2.6.6 are covered in this section. Pro- 
cedures for control charts based on Shewhart’s procedures 
are given in Appendix B. 


1.0030 


1.0020 


1.0010 


Meter Factor 


1,0000 


0.9990 


13.2.7.1 CONTROL LIMITS 


A hierarchy of control limits can be established as a cri- 
terion for several levels of activities for responding to un- 
usual changes in meter factors. The control limits may be 
based on the statistical variations of the individual meter or 
a group of meters or may be fixed based on experience and 


Individuals, MF 


Moving average, MF 


Meter Factor Sequence 


Figure 5—Individual and Moving Average Meter Factors for Example 
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Figure 6—Uncertainty of Individual Meter Factors in Relation to Current Moving Average 


mutual consent of the affected custody measurement par- 
ties. Control limits are computed on the assumption that 
meter factor variations are random or at least exhibit ran- 
dom characteristics. If meter factors deviate beyond control 
limits, it is normally assumed that the metering system is 
exhibiting a nonrandom or systematic change that results in 
a measurement bias. 

Statistically based control limits would normally be based 
on the ranges of confidence levels listed in Table 14. 

Warning limits can be used to indicate when it is appropri- 
ate to perform the following activities: 


a. Check meter proving equipment. 

b. Evaluate the stability of operating conditions. 
c. Check for valve leakage. 

d. Check computations. 


Action limits can be used to indicate when to consider any 
or all of the following activities: 


a. Recalibrating instrumentation. 

b. Inspecting, adjusting, cleaning, and repairing mechanical 
equipment. 

c. Issuing a correction ticket or tickets. 


Tolerance limits can be used to indicate when to consider 
performing any or all of the following activities: 


a. Conducting an intercompany audit or review of all equip- 
ment and computational procedures. 

b. Reviewing the adequacy of the custody transfer facility 
for potential equipment changes. 

c. Conducting laboratory analyses of metered fluid or fluids 
to verify properties used for computational purposes and to 
control operating conditions. 


13.2.7.2 CONTROL CHART OR LOG— 
FIXED LIMITS GIVEN 


Historically, fixed limits have been used for determining 
the acceptability of change between consecutive meter fac- 
tors and cumulative change from a baseline meter factor. 
Table 15 shows an example of a meter factor control log that 
incorporates a fixed limit for changes between consecutive 
meter factors and cumulative change in meter factors. 

Figure 8 is a graphical version of a control chart with fixed 
limits. Graphed control charts can also be combined with 
control chart logs. 
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Figure 7—Moving Average of Individual Meter Factors and Uncertainties of Moving Average 


13.2.7.3 STATISTICAL CONTROL CHARTS FOR 
MOVING SERIES—SINGLE METER, NO 
FIXED LIMIT 


The control chart procedures in this section are based on un- 
certainties of a moving series of meter factors. The example in 
13.2.6.5 and 13.2.6.6 (Table 12) will also be used to illustrate 
the development of a meter factor control chart. This example 
is repeated in Table 17. For illustration purposes, the control 
levels shown in Table 16 will be used for the control chart. 

The uncertainties of the moving average for the warning, ac- 
tion, and tolerance control limits with confidence levels of 90 
percent, 95 percent, and 99 percent, respectively, are given in 
Table 18. Uncertainty estimates of the moving average based on 
standard deviations are given in the left column for each control 
level. The right column under each control level gives uncer- 
tainty estimates of the moving average based on range values. 


Table 14—Statistical Control Levels 


Control Level Confidence Level 
Warning 90% to 95% 
Action 95% to 99% 

Tolerance 99% and greater 


Control limits based on the uncertainty estimates using 
standard deviations of the moving average meter factor are 
plotted in Figure 9. 

Uncertainties calculated from ranges are higher than 
those calculated from standard deviations for the first three 
meter factors. For meter factors four through ten, the uncer- 
tainty estimates of the moving average are similar and prob- 
ably within the overall uncertainties to determine individual 
meter factors. 

The uncertainties based on standard deviations for indi- 
vidual meter factors in Table 18 are plotted in Figure 9 for 
the three control levels with respect to the moving average 
meter factor, MF. Uncertainties for meter factors less than 
four are excluded from Figure 9 because the values are in- 
flated due to the characteristics of the ¢-distribution for a 
small amount of data during the learning period for a new or 
overhauled meter. 

As indicated in Table 18 and Figure 9, the uncertainties 
for individual meter factors in the moving series are rela- 
tively stable after five meter factors. The central line (base- 
line) and control limits for a control] chart after five meter 
factors are shown in Table 19. 

Figure 10 contains a control chart based on the limits 
given in Table 19. A log of individual meter factors and 
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Table 15—Example: Meter Factor Control Log 


Warning Limit Action Limit 
Consecutive MF change none +0.0025 
Cumulative MF change +0.0050 +0.0075 
Meter Factor Change 
Sequence Meter From From 
or Date Factor, MF Consecutive Baseline Comments 
1 0.9996 Baseline meter factor after repairs 
2 1.0012 +0.0016 +0.0010 
3 0.9993 0.0019 0.0003 
4 0.9999 +0.0006 +0.0003 
5 1.0010 +0.0011 +0.0016 
6 1.0021 40.0011 +0.0025 
7 1.0026 +0.0005 +0.0030 
8 1.0046 +0.0020 +0.0050 Warning limit met 
9 1.0050 +0.0004 +0.0054 Warning limit exceeded 
10 1.0000 — _ Meter repaired, new baseline 
11 1.0010 +0.0010 +0.0010 
12 1.0005 0.0005 +0.0005 
13 1.0022 +0,0017 +0.0022 
14 1.0078 +0.0066 +0,0078 Action limit exceeded. 
15 1.0006 _ _— Meter repaired; first factor 
16 1.0010 _ — New baseline 
17 1.0002 —0,0008 0.0008 
18 0.9992 -0,0010 0.0018 
_ _ _ Action 
10080 --  ——i‘“<C ge gaz sy 
Action (+0.0075) 
1.0070 |~(.9.0075) 
1.0060 __ Waming — _ 
1.0050 ;- Waming | (+0.0050) 
1.0040 | (0.0050) 
1.0030 
1.0020 
S 1.0010 
Me NR GB SIR NES Se re 
& — 4,0000 Baseline 
= 0.9990 Baseline 
= 
0.9980 
0.9970 
0.9960 |— _ _ Waming — _ 
0.9950 Waning (0.0050) 
0.9940 }—(— 0.0050) : 
Action 
O8930 = EY 
_ Action = HH (-0.0075) 
0.9920 F-(- 0.0075) 
| It it me oe | 
at 0 5 10 15 20 25 


Meter Factor Sequence 


Figure 8—Meter Factor Control Chart With Fixed Control Limits 
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Table 16—Example on Meter Factor Control Levels 


moving series based on the statistical values given in 
Table 20. 


Control Level Ponhdence Level Control lines for the cumulative average of the series of 
Warning 90% meter factors in Table 20 are shown in Table 21. The initial 
Action 95% control lines are based on the cumulative average and uncer- 
Tolerance 99% tainties after five meter factors. Also note that the control 


moving statistical values should also be maintained as part 
of the historical records. The control limits should be re- 
viewed and revised when appropriate after more meter fac- 
tors are developed. Control limits should also be compared 
to fixed limits so that broad limits based on erratic meter 
proving data do not prevail. Normally, the control limits can 
be reduced or tightened when a substantial number of meter 
factors are available. However, delays in establishing con- 
trol limits will delay the use of the control chart in detecting 
outliers and systematic trends. 

For trend analyses, control logs and/or charts can be es- 
tablished for the cumulative average meter factor of a 


lines can be revised after ten meter factors as the uncertainty 
estimate becomes lower. 

The control chart for the example in Table 20 and control 
lines in Table 21 is shown in Figure 11. Also included for il- 
lustration purposes are additional meter factors beyond the 
example in Table 20. 

Control charts for moving averages can also be weighted 
so that the most current data is given a higher weighted value 
than earlier data. This will cause the moving average to be 
more sensitive to recent changes in meter factors, and trends 
will be detected sooner. However, normal statistical varia- 
tions in current data will also be amplified and control limits 
are more likely to be exceeded by both random and system- 
atic changes. 


Table 17—Example: Statistical Values for a Moving Series 


Moving Statistical Values of 


Individual Set Data Moving Series 
Average Moving Standard 
Sequence Meter Factor, Average, Range, Deviation, 
Number MF MF w(MF) (MFP 
1 0.9996 
2 1.0012 1.0004 0.0016 +0.00113 
3 0.9993 1.0000 0.0019 +0.00102 
4 1.0009 1.0002 0.0019 +0.00094 
5 1.0005 1.0003 0.0019 +0.00082 
6 0.9990 1.0001 0.0022 +0.00091 
4 1.0004 1.0001 0.0022 +0.00084 
8 1.0013 1.0003 0.0023 +0.00088 
9 1.0000 1.0002 0.0023 +0.00083 
10 1.0018 1.0004 0.0028 +0.00092 


Standard deviation of prior individual meter factors, MF, up to and with respect to current moving average. 


Table 18—Uncertainties of Individual Meter Factors in a Moving Series 
for Various Control Levels 


Uncertainties Versus Control Level 


Warning Level Action Level Tolerance Level 
Set Based on Based on Based on 
Sequence Based on Standard Based on Standard Based on Standard 
Number Range Deviation Range Deviation Range Deviation 
] Ses — — — — 2 
2 0.0090 +0.0071 +0,0180 +0,0144 +0.0093 +0.0719 
3 +0.0033 +0.0030 +0.0048 +0.0044 +0.0111 +0.0101 
4 +0.0022 +0.0022 +0.0029 +0.0030 +0.0054 +0.0055 
5 +0.0017 +0.0017 +0.0023 +0.0023 +0,0036 +0.0038 
6 +0.0017 +0,0018 +0,0022 +0.0023 +0.0034 +0.0037 
7 +0.0016 +0,0016 +0.0020 +0.0021 +0.0029 +0.0031 
8 +0.0015 +0.0017 +0.0019 +0.0021 +0.0028 +0.0031 
9 +0.0014 +0,0015 0.0018 20.0019 +0.0026 +0,0028 
10 +0.0017 +0.0017 +0.0021 +0.0021 +0.0029 +0.0030 
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Figure 9—Statistics of Moving Series of Meter Factors 
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Figure 10—Control Chart for Individual Meter Factors 
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Table 19—Control Chart Lines for Individual Meter 
Factors in a Moving Series 


Description of Meter Factor 
Control Chart Line Value 
Central line (baseline) 1,0003 
Upper warning limit 1,0020 
Upper action limit 1,0026 
Upper tolerance limit 1.0041 
Lower warning limit 0.9986 
Lower action limit 0.9980 
Lower tolerance limit 0.9965 


13.2.7.4 CONTROL CHARTS FOR GROUPS OF 
METERS 


Control charts can also be developed for groups of meters 
that experience similar fluids, design, and operating parame- 
ters. The example in Table 22 illustrates how control charts or 
logs can be used to identify meters and meter factors that are 
out of statistical control. These statistical procedures can also 
be used to evaluate fixed standards for meter factor acceptance. 

Control chart analyses can be performed on a bank of sim- 
ilar meters experiencing similar operating conditions and me- 
tering similar fluids. This relative comparison can be helpful 
in identifying erratic performance of one or more meters in a 
group caused by poor mechanical conditions, inadequate flow 
control, or other facility deficiencies. Control charts covering 
groups of meters can also be helpful in evaluating mainte- 
nance and operating programs at different locations or be- 
tween different operating parties. 

Table 23 provides a summary of changes in consecutive 
meter factors for the five meters in Table 22. A control chart 
will be constructed for the changes that occur between con- 
secutive meter factors. 

Control charts (or logs) can be developed for the example 
in Table 23 to evaluate the following variations: 


a. Average absolute change between consecutive meter fac- 
tors of each meter with respect to the average absolute 
change between consecutive meter factors for all meters. 

b. Absolute changes in consecutive meter factors changes of 
each meter with respect to its average absolute change. 

c. Absolute change in consecutive meter factors of each me- 
ter with respect to the overall average of absolute changes in 
consecutive meter factors for a group of meters. 


The control chart lines for the average absolute change in 
consecutive meter factors of each meter with respect to the 
overall average of absolute changes in consecutive meter fac- 
tors of all meters are determined as follows: 


a. Central line (CL): 


CL =w (overall average change) 


(0.00084 + 0.00098 + 0.00080 + 0.00072 + 0.00132) 
5 


w= 


0.00093 
b. Upper action limit (UAL): 


UAL = w+ [Z(95, 5)][w(w)] (see note) 
ww) = 0.00132 — 0.00072 = 0.00060 


UAL = 0.00093 + (1.193)(0.00060) 
0.00165 
c. Lower action limit (LAL): 
LAL w- [2(95, 5)] [w(w)| (see note) 
0.00093 — 0.00072 
= 0.00021 
Note: See Table 10 for Z in Items b and c above. 


Figure 12 shows the control chart with action control limits 
for the overall average absolute change for meters A, B, C, D, 
and E. Warning and tolerance control levels could also be in- 
cluded on the control chart but are excluded for simplification. 


Table 20—Statistical Values for a Moving Average, MF 


Average Moving 
Sequence Meter Factor, Average, 
Number MF MF 
1 0.9996 = 
2 1.0012 1.0004 
3 0.9993 1.0000 
4 1,0009-- 1.0002 
3 1.0005 1.0003 
6 0.9990 1.0001 
7 1.0004 1.0001 
8 1.0013 1.0003 
9 1.0000 1.0002 
10 1.0018 1.0004 


Uncertainty Values for Control Levels” 


Warning Action Tolerance 
+0.0050 +0.0102 +0.0508 
+0.0017 +0.0025 +0.0058 
40.0011 +0.0015 +0.0028 
+0.0008 +0.0010 40.0017 
+0.0007 +0.0009 +0.0015 
+0.0006 +0.0008 +0.0012 
+0.0006 +0.0007 +0.0011 
+0.0005 +0.0006 20.0009 
+0.0005 +0,0007 +0.0009 


“Based on dividing the calculated uncertainty values in Table 19 by the square root of the sequence number 


(number of meter factors). 
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Control limits 
revised after 
ten meter factors 


1.0020 


1.0010 


1.0000 


Moving Average Meter Factor 


0.9990 


0.9980 
Q 5 10 15 20 


Meter Factor Sequence 


Note: UTL = upper tolerance level; UAL = upper action level; UWL = upper warning level; 
LWL = lower warning level; LAL = lower action level, LTL = lower tolerance level; and CL = central line. 


Figure 11—Control Chart for Moving Cumulative Average of Meter Factors 


Although all five meters are within the action limits shown a. Central line (CL): 
in Figure 12, the average absolute change for meter Eis sub- a 
stantially greater than that of the other meter. Inclusion of cL =w 
meter E causes substantially broader action limits than those = (0.00084 + 0.00098 + 0.00080 + 0.00072) 
of meters A, B, C, and D without meter E. If meter E is ex- Oe ae eS ee 


cluded from the database for the control limits, the revised 


0.00084 
control lines would be as follows: 


‘| 


b. Upper action limit (UAL): 


w + (Z(95, 4)][»(w)] 
w(w) = 0.00098 — 0.00072 


Table 21—Control Chart Lines for the Moving UAL 
Average of Series of Meter Factors 


Meter Factor Values 

Description of Control After 5 MF After 10 MF = 0.00026 
Central line (CL) 1.0003 1.0004 UAL = 0.00084 + (1.545)(0.00026) 
Upper warning limit (UWL) 1.0011 1.0009 = 0.00124 
Upper action limit (UAL) 1.0013 1,0011 c. Lower action limit (LAL): 
Upper tolerance limit (UTL) 1.0020 1.0013 + 
Lower warning limit (LWL) 0.9995 0.9999 LAL = w - [Z(95, A)][(w)| 
Lower action limit (LAL) 0.9993 0.9997 LAL = 0.00084 - 0.00040 
Lower tolerance limit (LTL) 0.9986 0.9995 = 0.00044 
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a 


Table 22-—Example: Meter Factors for Five Meters 


SS 5 ee ee es 


Meter Factors Versus Meter Designation 


Sequence a,c 
Number A B Cc D E 

1 1.0002 0.9904 0.9980 1.0028 0.9997 

2 1.0010 0.9982 0.9994 1.0021 0.9988 

3 0.9995 1.0001 0.9990 1.0022 0.9991 

4 0.9999 0.9992 0.9982 1.0030 0.9980 

5 1.0005 0.9996 0.9996 1.0028 1.0000 

6 0.9996 1.0010 0.9991 1.0039 0.9981 

7 1.0006 1.0006 1.0000 1.0042 0.9996 

8 1.0009 1.0018 0.9998 1.0031 1.0016 

9 1.0018 1.0000 1.0010 1.0039 1,0004 

10 1.0010 1.0002 1.0001 1.0044 1.0011 

11 1.0011 0.9990 0.9993 1.0030 0.9990 

12 0.9992 0.9992 0.9996 1,0021 0.9998 


Table 23—Summary of Change Between Consecutive Meter Factors 


Absolute Change Between Consecutive Meter Factors, w 


Sequence ee ene CCU ICISL RACIOIS WE! SS 
Number A B Cc D E 
a ee 
1 = “ a = = 
2 0.0008 0.0012 0.0014 0.0007 0.0009 
3 0.0015 0.0019 0.0004 0.0001 0.0003 
4 0.0004 0.0009 0.0008 0.0008 0.0011 
5 0.0006 0.0004 0.0014 0.0002 0.0020 
6 0.0009 0.0014 0.0005 0.0011 0.0019 
7 0.0010 0.0004 0.0009 0,0003 0.0015 
8 0.0003 0.0012 0.0002 0.0011 0.0020 
9 0.0009 0.0018 0.0012 0.0008 0.0012 
10 0.0008 0,0002 0.0009 0.0005 0.0007 
"1 0.0001 0.0012 0.0008 0.0014 0.0021 
12 0,0019 0.0002 0.0003 0.0009 0.0008 
Average 
absolute 
change (w) 0.00084 0.00098 0.00080 0.00072 0.00132 
Overall range 
in consecutive 
meter factor 
changes, w(w) 0.0018 0.0017 0.0012 0.0013 0.0017 
Figure 13 shows a modified control chart with action lim- b. Upper action limit (UAL): 
its based on meters A, B, C, and D. For development of at- = —)— 
tainable standard meter factor ranges, it would normally be CALS [2(95, 11) I™)] 
preferable to delete meter E’s ranges from the database since obi (0.0018 + 0.0017 + 0.0012 + 0.0013 + 0.0017) 
it is not typical of the other meters. Inclusion of meter E in w(w) = ee 
the database results in considerably broader limits. = 0.00154 
The control chart for the individual absolute changes in : 
consecutive meter factors on all five meters would have the UAL = 0.00093 + (0.702)(0.00154) 
following lines: = 0.00201 


a. Central line (CL): c. Lower action limit (LAL): 


2 LAL = w ~ [Z(95, 11)][w(w)] 


CL = w 
= _ (0.00084 + 0.00098 + 0.00080 + 0.00072 + 0.00132) = 0.00093 — (0.702)(0.00154) 
v= sc WD ererovwrvrrr 
- = ~0.00015 
= 0.00093 LAL = Q, since LAL cannot be less than zero 
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So 0.0020 ;— 


-- eee ee eee er er rc crc c tcc ccccn Upper action limit 
0.0015 t— 
Average absolute change 


between consecutive meter 
factors 


0.0010 —— oS) Central line 


Average Absolute Change 
Between Consecutive Meter Factors 


0.0005 ;— 


Lower action limit 


0.0000 


A B c D E 


Meter Designation 


Note: Upper action limit, central line, and lower action limit are based on five meters. 


Figure 12—Controt Chart for Average Absolute Change Between Consecutive Meter Factors 


The control chart for individual absolute changes between c. Lower action limit (LAL): 
consecutive meter factors based on all five meters is shown = —/— 
in Figure 14. ea ae [2(95, 11)][>(»)| 
Absolute changes between consecutive meter factors for = 0,00084 — 0.00105 
meter E are also plotted in Figure 14 for illustration pur- = 0.00021 
poses. _ : F 
If the absolute changes in consecutive meter factors for LAL = 0, since — 0.00021 is less than zero 
meter E are excluded from the database, the control lines for Figure 15 plots the absolute changes in consecutive meter 
individual ranges in consecutive meter factors would be as factors for meter E with respect to the control lines based on 
follows: meters A, B, C, and D. Three of meter E’s absolute changes 


in consecutive meter factors fall outside the action limits 


a. Central line (CL): shown in Figure 15 


= ll 


CL = 


w = 0.00084 
b.. Upper action limit (UAL): 


UAL = w + [2(95, 11)][»(w)} 
~/-, _ 0.0017 + 0.0017 + 0.0012 + 0.0013 
ww) = 


4 
= 0.0015 
UAL = 0.00084 + (0.702)(0.0015) 
= 0.00189 


Copyright por American Petroleum Institute 
Fri Jan 11 21:38:52 2002 


24 


Average Absolute Change 
Between Consecutive Meter Factors 


API MPMS*13.2 94 MM 0732290 0541395 ST a 


CHAPTER 138—STATISTICAL ASPECTS OF MEASURING AND SAMPLING 


0.0020 


0.0015 


Average absolute change between 
consecutive meter factors ee 


Upper action limit 


0.0010 
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0.0005 Lower action limit 


A B Cc D E 


Meter Designation 


Note: Upper action limit, centerline, and lower action limit are based un meters A, B, C, and D. 


Figure 12—Revised Control Chart for Average Absolute Change Between 
Consecutive Meter Factors 
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Figure 14—Control Chart for Absolute Consecutive Meter Factor Changes for Meter E 
(All Meters Used for Control Limits) 
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Figure 15—Control Chart for Absolute Changes in Gonsecutive Meter Factors 
(Meter E Excluded for Control Limits) 
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APPENDIX A—EXAMPLES OF METER PROVING UNCERTAINTY COMPUTATIONS 


A.1 Example A-1: Uncertainties in a 


Moving Average 
Estimate uncertainties in the moving average of the set of 
meter proving runs shown in Table A-1. 


A.1.1 STEP 1 


Calculate the moving range using Equation 3 and estimate 
the uncertainty of the moving average using Equation 20 for 
proving runs one and two in Table A-1 as follows: 


w(MF) = 0.9990 - 0.9988 
= 0.0002 
a(0.99890) = [2(95, 3}][w(MF)] (see Table 11) 
= (7.965) (0.0002) 
= £0.0016 
A.1.2 STEP 2 


Calculate the moving ranges and estimate the uncertain- 
ties of moving averages for proving runs 3 through 10 and 
summarize the results as shown in Table A-2. 


A.2 Example A-2: Potential Annual 
Uncertainty in Meter Factor 
Acceptance Criterla 


Estimate the potential average annual uncertainty at a 95 
percent confidence level with the following meter proving 
acceptance criteria: 


a. Minimum number of proving runs = three. 
b. Range limits for three proving runs = 0.0005. 


Table A-1—Example A-1: Meter Proving Set 


Average Meter Factors 


Proving Runs 


Sequence, n Individual, MF Moving Average, MF 

1 0.9990 _ 

2 0.9988 0.99890 
3 0.9994 0.99907 
4 0.9992 0.99910 
5 0.9993 0.99914 
6 0.9989 0.99910 
7 0.9995 0.99916 
8 0.9992 0.99916 
9 0.9985 0.99909 
10 0.9992 0.99910 
11 0.9990 0.99909 
12 0.9998 0.99915 
13 0.9986 0.99911 
14 0.9992 0.99911 
15 0.9991 0.99911 
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c. Minimum proving period = monthly. 
d. Deviation limit between consecutive meter factors = 
0.0025. 


A.2.1 STEP 1 


Estimate the potential average annual uncertainty associ- 
ated with meter run acceptance criteria as follows: 


a. The estimated standard deviation of the average in a sin- 
gle set of three runs that agree within a range of 0.0005 is 
calculated as follows: 


(iar) 


ess 

{3 D3) 
00005 

~ (1.732)(1.693) 
0.00017 


b. The potential average annual uncertainty associated with 
meter run acceptance criteria is as follows: 


a( MF = [7(95, 12)][s(F)] (sce Table 9) 


(ii?) 


(0.635)(+0.00017) 


+ 0.00011 

The potential average annual uncertainty associated with the 
meter run acceptance criteria of three runs that agree within 
a range of 0.0005 propagates to an average annual value of 
+0.00011 when repeated 12 times (monthly) over a year. 


A.2.2. STEP 2 


Estimate the potential average annual uncertainty associ- 
ated with a deviation limit between consecutive meter factors 
of 0. 0025. 


a. The standard deviation of the average in two consecutive 
meter factors that agree within a range of 0.0025 is as fol- 
lows: 

a We 

@) 0@) 

0.00025 
(1.414)(1.128) 

= 0.00157 

b. The potential average annual uncertainty associated with 
the consecutive meter factor deviation limit is as follows: 


a{MF) = [7(95, 12)]]|s(MF)] (see Table 9) 


(iF) 


a{MF) = (0.635)(0.00157) 


+0.00100 
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Table A-2—Statistical Summary of the Moving Average of a Sequence 
of Meter Proving Factors 


Proving Runs Data Moving Statistical Values 


Sequence, n Meter Factor Average Range Uncertainty* 
1 0.9990 ae = = 
2 0.9988 0.99890 0.0002 +0.0016 
3 0.9994 0.99907 0.0006 +0.0009 
4 0.9992 0.99910 0.0006, +0.0005 
5 0.9993 0.99914 0.0006 +0.0003 
6 0.9989 0.99910 0.0006 +0.0003 
7 0.9995 0.99916 0.0007 +0.0002 
8 0.9992 0.99916 0.0007 +0.0002 
9 0.9985 0.99909 0.0010 +0.0003 
10 0.9992 0.99910 0.0010 +0.0002 
1l 0.9990 0.99909 0.0010 +0.0002 
12 0.9998 0.99915 0.0013 +0.0003 
13 0.9986 0.99911 0.0013 +0.0002 
14 0.9992 0.99911 0.0013 +0.0002 
15 0.9991 0.99911 0.0013 +0.0002 


“Of moving average, i.e., a(MF) = Z(95, m)[w(n)]. 


The potential average annual uncertainty associated with the 


deviation limit between consecutive meter factors propagates a(MF) = [(9s. 5)| [w(MF) ene) 


to an average annual value of 0.00100 when repeated 12 = (0.540) (0.0005) 
times over a year. = +0,00027 
A.2.3 STEP3 A.3.2 STEP 2 
Combine the potential average annual uncertainties of the Calculate moving ranges that equal the uncertainty of Step 
two meter proving acceptance requirements as follows: 1 above: 
a( MF} = ,(+0.00011)? + (0.00100)" w(MF) = (MF) (6a nate) 
= +0.00101 2(95. ») 
A.3.3. STEP 3 


In example A-2, the uncertainty associated with the meter 


run acceptance criteria has a negligible effect on the potential For three runs, calculate: 


average annual uncertainty. This effect is primarily due to the +0.00027 
relatively large deviation limit between consecutive meter w(MF) = aea 
factors, which is five times greater than the range limit for a 6 600% 


set of three meter proving runs. The potential average annual 


uncertainty completed in example A-2 is a worst-case value 
because it is unlikely that the range for sets of meter proving 
runs and the deviation between consecutive meter factors will 
be. equal to the limits every time. a meter factor is determined. 


A.3 Example A-3: Variable Range Meter 
Factor Acceptance Criteria 


Calculate ranges for sets of 3 to 15 meter proving runs that 
equal the estimated uncertainty of the average of 5 runs that 
agree within a range of 0.0005. The confidence level for 
analyses is 95 percent. 


A3.1 STEP 1 


Estimate the uncertainty of the average associated with 
five proving runs that agree within a range of 0.0005: 


A.3.4 STEP 4 


For meter proving sets of 4 to 15 runs, calculate the vari- 
able ranges and summarize as shown in Table A-3. 


A.4 Example A-4: Uncertainty Limit 
Meter Factor Acceptance Criteria 


Calculate the uncertainty of a moving series of meter fac- 
tors until the uncertainty of the average of the cumulated set 
equals +0.00025 or less at 95 percent confidence level. The 
example in Table A-2 will be used for illustration purposes. 
Statistical values are summarized in Table A-4. 

The uncertainty of the average in the moving set after six 
runs meets the uncertainty criteria for the meter proving set. 
Therefore, the meter proving set is accepted after six runs are 
completed. 
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Table A-3—Variable Ranges for +0.00027 Uncertainty 
in Meter Factors 


Number of Meter Factors Moving Range 
3 0.0002 
4 0.0003 
5 0.0005 
6 0.0006 
vs 0.0008 
g 0.0009 
9 0.0010 

10 0.0012 
at 0.0013 
12 0.0014 
13 0.0015 
14 0.0016 
15 0.0017 


Table A-4—Summary of Unceriainties in the Average in a Moving Series of Meter 
Proving Factors 


Moving Statistical Values 


Proving Data Standard 
Sequence, 7 Meter Factor Average Deviation* Uncertainty” 

1 0.9990 _ _ _— 

2 0.9988 0.99890 +0.00014 +0.00127 
3 0.9994 0.99907 +0.00031 +0.00076 
4 0.9992 0.99910 +0.00026 +0.00041 
5 0.9993 0.99914 +0.00024 +0.00030 
6 0.9995 0.99910 +0.00024 +0.00025 


Standard deviation of the moving set up to the number of proving runs. 
‘Uncertainty in the average of the moving set of meter proving runs. 


For illustration purposes, calculations of standard deviation and uncertainty after three 
meter factors are given below using Equations 3 and 14 and the data in Table A-4, 


s(MF) = yaaa my + (ME,-MF) + (mr, - 4) | 
(MF.-MF) = (0.99900 - 0.99907)" = 0.5 x 10° 
(MF,-MF) = (0.99880 - 0.99907) = 7.3 x 10° 
(MF,-MF) = (0.99940 — 0.99907)" = 109 x 10° 
X(MF-MF) = 18.7 x 10° 
(1487 x 10°) 
s(MF) = Vas? x 10°) 
= 3.1.x 10° 
a(MF) = [7(95, 3)|[s(MF)] 
a(0.99907) = (2.484)(0.00031) 
= +0.00076 
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APPENDIX B—EXAMPLES OF OUTLIER TESTS 


Since no single document can cover all of the statistical 
procedures and applications being practiced, outlier tests 
other than those appearing in Appendix B may be used. Al- 
ternate outlier tests are not expected to duplicate the exact re- 
sults provided by these procedures; however, alternate 
computational methods should achieve the same purpose in- 
tended by the outlier tests in this appendix. 

B.1 Example B-1—Dixon’s Test for 
Outliers 


Appendix B of Chapter 13.1 of the Manual of Petroleum 
Measurement Standards includes information on Dixon’s 
test for outliers that can be applied to a meter proving set. 
Outliers can inflate the standard deviation, range, and uncer- 
tainty of a meter proving set. 

Dixon’s outlier test is not normally practical for hand cal- 
culations. However, increasing use of computers in custody 
measurement now permits the use of statistical outlier tests 
on sets of meter proving data. The example of a set of meter 
proving data shown in Table B-1 will be used to illustrate the 
use of Dixon’s outlier test. 

In the outlier test, the meter factors are arranged in ascend- 
ing order of magnitude as shown in Table B-2. 

The following steps from Appendix B of Chapter 13.1 il- 
lustrate the outlier test for high and low values in the meter 
proving set using the ascending order run sequence. 


B.1.1 STEP 1 


Test the lowest ascending order value as follows: 


a. Calculate Dixon R ratio. 


Table B-1—Initial Meter Factor Sequence 


Meter Factor Sequence Calculated Meter Factor 


Soeands Mhwne 
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_ MF - MF 
ua MF, - MF, 
_ 1.0004 — 1.0000 

1.0008 — 1.0000 
0.500 
b. Look up Dixon R limits for 2 = 15 values. 

1, R(95) limit = 0.525. 

2. R(99) limit = 0.616. 
c. Compare calculated Dixon R ratio against Dixon limits. 
Since 0.500 is less than 0.525, the lowest value is not ex- 
cluded from the meter proving set. 


B.1.2 STEP 2 
Test the highest ascending order value as follows: 


a. Calculate Dixon R ratio. 


MF, = MF; 
Ko = MR. MB, 
15 7 3 
_ 1.0015 — 1.0008 
1.0015 — 1.0004 
= 0.636 


b. Look up Dixon R limits for n = 15 values. 

1, R(9S5) limit = 0.525. 

2, R(Y9) limit = 0.616. 
c. Compare calculated Dixon R ratio against Dixon limits. 
Since 0.636 is greater than 0.525 and 0.616, the highest ascend- 
ing order value should be automatically excluded from the set. 
d. Repeat test with remaining values. 


Table B-2—Ascending Order for Outlier Test 


Ascending Initial Run 
Order Sequence Value 
1 5 1.0000 
2 9 1.0003 
3 1 1.0004 
4 6 1.0004 
5 8 1.0005 
6 3 1.0005 
7 11 1.0005 
8 15 1.0006 
9 2 1.0006 
10 12 1.0006 
11 4 1.0007 
12 13 1.0007 
13 10 1.0008 
14 7 1.0009 
15 14 1.0015 
MF = 1.0006 
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B.1.3 STEP 3 


Test the lowest value in the remaining ascending order set 
as follows; 


a. Calculate Dixon R ratio: 

_ MF,- MF 
“ME, - MF, 
1.0004 -— 1.0000 
1.0007 — 1.0000 
0.571 


b. Look up Dixon R limits for 2 = 14 values: 

1. R(95) = 0.546. 

2, R99) = 0.641. 
c, Compare Dixon R ratio against Dixon limits. Since R,,,, 
0.571, is greater than 0.546 but less than 0.641, ascending or- 
der run number one is not automatically excluded but could 
be rejected. Since exclusion of run number one will not ap- 
preciably reduce the number of meter factors, it should be 
eliminated from the data set. 


R, 


B.1.4 STEP 4 
Test the highest value in the remaining set as follows: 


a. Calculate Dixon R ratio for n = 14 values. 


Re Sey 
‘” MF, - MF, 
_ 1.0009 - 1.0007 
~ 17,0009 — 1.0004 
= 0.400 


b. Look up Dixon R limits for n = 14 values. 

1. R(95) = 0.546. 

2. R(99) = 0.641. 
c. Compare Dixon ratio against Dixon limits. Since Rig is 
less than 0.546 [R(95)] and 0.641 [R(99)], the high value in 
the set should not be excluded. 


B.1.5 STEP5 


Test the lowest meter factor in the remaining ascending 
order set as follows: 


a, Calculate Dixon R ratio. 
MF, — MF, 
Rw Se eee 
MF; - MP, 
_ 1,0004 — 1.0003 
1.0008 -— 1.0003 
0.200 
b. Look up Dixon R limits for 1 = 13 values. 
1. R95) = 0.521. 
2. R99) =0.615. 
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¢. Compare Dixon R ratio against Dixon limits. Since R,,,, is 
less than 0.521 [R(95)] and 0.615 [R(99)], the remaining low 
value in the set should not be excluded. 


The data set remaining after completion of the outlier test 
is given in Table B-3. 

Although the average meter factor (MF) in this example 
remained at 1.0006 after the outlier test as shown in Table B- 
3, the estimated uncertainty in the calculated value was re- 
duced from +0.0002 to +0.0001 as shown with the following 
computations: 


a. Estimated a(MF) before outlier test: 

a(MF) = [2(95, 15)][w(ar)] 
(0.160) (0.0015) 

= +0.0002 

b. Estimated a(MF) after outlier test: 

a(MF) = [2(95, 13)][w(MF)] 
(0.181)(0.0006) 
+0.0001 


B-2 Example B-2—Uncertainty 
Minimization Outlier Test 


The purpose of this example problem is to illustrate an al- 
ternate method of evaluating potential outliers in a set of data 
such as a set of meter proving runs. The procedure involves 
a series of uncertainty estimates on reducing ranges and us- 
ing Student f functions until the uncertainty of the average in 
the set approaches a minimum value. The extreme values in 
the set that constitute the high and/or low values are then re- 
jected so that the remaining values in the set result in a min- 
imum value of uncertainty in the average of the remaining 


Table B-3—Remaining Data Set After Outlier Test 


Initial Sequence* Meter Factor 


1 
2 
3 
4 
6 
7 
8 
9 1,0003 
10 
11 
12 
13 
15 


“Original meter factors 5 and 14 are excluded from the final set. 
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data set. Statistical values for a 99 percent or higher confi- 
dence level are normally used for outlier tests. Example B-1 
will be used to illustrate this procedure. 

The estimated uncertainty of the average in the set of 
proving runs in Table B-2 is as follows: 


[2(0%, 15)|[w(MF)] 
2(99, 15) = 0.221 
w(MF) = 1.0015 — 1.0000 
= 0.0015 
a(MF) = (0.221)(0.0015) 


= +0.00033 
If the first and last values in ascending order are elimi- 
nated, the resulting uncertainty in the average of the remain- 
ing 13 values would be as follows: 


a(MF) = [2(99, 13)][»(™F)] 
2(99, 13) = 0.254 
w(MF) = 1.0009 — 1.0003 


(MF) 


In this example, the uncertainty of the average in the set of 
runs is reduced from +0.00033 to +0.00010 (99 percent con- 
fidence level) by eliminating high and low values in the orig- 
inal data set. This process can be continued by evaluating the 
uncertainty of the remaining set with and without the remain- 
ing high and/or low values. Table B-4 summarizes the uncer- 
tainties in averages of sets that are reduced one at a time by 
the run that is the farthest from the average of the set. 

As shown in Table B-4, the uncertainty of the average in 
the set reduces until only ten values remain in the set. Further 
elimination of high and/or low values from the set results in 
an increase in the estimated uncertainty of the average in the 
remaining set. Runs 1, 2, 13, 14, and 15 are excluded as out- 
liers from the original data set. 


= 0.0004 
a(MF) = (0.254)(0.0004) 
= +0.00010 
Table B-4—Summary of Uncertainty Estimates 
Number Eliminated Run Uncertainty of Average 
of Values Numbers* Range at 99% Confidence 
15 0 0.0015 +0.00033 
14 15 0.0009 +0.00021 
13 1 0.0006 +0.00015 
11 2,14 0.0004 +0.00012 
10 13 0.0003 +0.00010 
7 3.4, 12 0.0002 +0.00013 


"Ascending order runs from Table B-2. 
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APPENDIX C—SHEWHART CONTROL CHARTS 


C.1 


The basic control chart used in most industrial applica- 
tions was developed by Walter A. Shewhart. However, 
general use of Shewhart statistical procedures for control 
charts on meter factors is not recommended. Shewhart’s 
procedures were developed to evaluate whether a process 
is or is not in a state of statistical control relative to itself 
or to some standard value. Statistics are derived from data 
collected within rational subgroups and compared to limits 
based on past experience, the data themselves, or standard 
values. Control charts can be developed for individual 
measurement sets, averages of measurement sets, ranges 
within sets, standard deviations within sets, and ranges be- 
tween individual measurements. 

Procedures by Shewhart are based on his concepts of 
appropriate empirical and economic considerations. Con- 
trol limits are based on three multiples of the standard de- 
viation of the data being evaluated for statistical control. 
However, the uncertainties associated with the control lim- 
its are not always equivalent to a 99.7 percent confidence 
level, which is implied with +3 standard deviations, be- 
cause averages of statistical quantities are used for compu- 
tations of control limits. 

Shewhart control chart procedures are generally appro- 
priate for post manufacturing evaluation of relatively large 
samples where a manufacturing process is mature and 
somewhat predictable. However, some of the control chart 
procedures may not be appropriate during startup of a new 
facility where experience with the operation is limited 
and/or where the number of samples is low. The use of av- 
eraged statistical variations within the sets requires that 
statistical variations between sets must be minimal. This is 
seldom the case for meter factors unless proving intervals 
are relatively short. Therefore, Shewhart control charts are 
not normally appropriate for statistical control of meter 
proving data. 

Extensive information on Shewhart control chart proce- 
dures may be found in ASTM MNL 7, ANSI/ASQC Al, 
and ANSI/ASQC B1, B2, and B3 (see 13.2.4 for complete 
information). 


Introduction 
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C.2 Shewhart Control Charts for 
Averages 


Shewhart statistical control limits for the averages of 
sets of meter factors are determined by the following 
equations: 


3[(uF)| 


Ft 
k- 05 
or 
— _ 3|w(MF)| 
MF + 
D(k)k 
Where: 
- 8 ty + 5, 
k 
and 
— Wet Wy we Wy 
k 


The following factors are provided in publications refer- 
enced in C.1, and tabulated values are given in Table C-1 for 
use in hand computations: 


peta 
k- 05 


F + H[s(MF)] 


Control limits = 


=< 
()[D()] 


Control limits = MF + c[w(MF)] 


Equations for central lines and control limits for stan- 
dard deviation and range control charts are given in Table 
C-1, and factors for computing control limits are shown in 
Table C-2. 

Table C-3 contains an example illustrating the use of Shew- 
hart methodology for developing a control chart. In the exam- 
ple shown in Table C-3, control charts can be developed for 
each set's average, standard deviation, and range. The control 
lines for the control charts are as follows: 
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Table C-i—Nomenciature for Control Chart Lines 
Quantity to Central Lower Control Upper Control 
Be Evaluated Line Limit Limit 
Averages MP MF- (H\(5) MF + (AY(s) 
Standard 
Deviations Ss (sy Uys) 
Ranges w (Kw) (L\w) 
Table C-2—Shewhart Control Chart Factors for Averages 
Number of Shewhart Conversion Factors 
Measurements G H I J K L 
in Sets, k Ay" A; B; B, D; D; 
2 1.880 2.659 0 3.267 0 3.267 
3 1.023 1.954 0 2,568 0 2.575 
4 0.729 1.628 0 2.266 0 2.282 
5 0.577 1427 0 2.089 0 2.114 
6 0.483 1.287 0.030 1.970 0 2.004 
7 0.419 1.182 0.118 1.882 0.076 1.924 
8 0.373 1.099 0.185 1.815 0.136 1.864 
9 0.337 1.032 0.239 1.761 0.184 1.816 
10 0.308 0.975 0.284 1.716 0,223 1.777 
11 0.285 0.927 0.321 1.679 0.256 1.744 
12 0.266 0.886 0.354 1.646 0.283 1.717 
13 0.249 0.850 0.382 1.618 0.307 1.693 
14 0.235 0.817 0.406 1,594 0.328 1.672 
15 0.223 0.789 0.428 1.572 0.347 1,653 
16 0.212 0.763 0.448 1.552 0.363 1.637 
17 0.203 0.739 0.466 1,534 0.378 1.622 
18 0.194 0.718 0.482 1.518 0.391 1.609 
19 0.187 0.698 0.497 1.503 0.404 1.596 
20 0.180 0.680 0.510 1.490 0415 1.585 
2) 0.173 0.663 0,523 1.477 0.425 1.575 
22 0.167 0.647 0.534 1.466 0.435 1.565 
23 0.162 0.633 0.545 1.455 0.443 1.557 
24 0.157 0.619 0.555 1.445 0.452 1.548 
25 0,153 0.606 0.565 1.435 0459 1.541 
“Traditional nomenclature for Shewhart conversion factors. 
Table C-3—Statistical Data for Shewhart Control Chart 
Average Standard 
Set Setar Runs Meter Factor, Deviation, Range, 
Number MFI MF2 MF3 MF4 MP5 MF s(MF) w(MF) 
1 0.9995 0.9994 0.9998 0.9995 0.9999 0.9996 0.00020 0.0005 
2 1.0011 1.0010 1.0013 1.0014 1.0012 1.0012 0.00018 0.0004 
3 0.9992 0.9994 0.9990 0.9993 0.9996 0.9993 0.00022 0.0006 
4 1.0010 1,0009 1,0011 1.0007 1.0009 1.0009 0.00015 0,0004 
5 1.0002 1,0007 1,0004 1.0005 1.0006 1.0005 0.00019 0.0005 
6 9.9992 0.9989 0.9991 0.9989 0.9990 0.9990 0.00013 0.0003 
7 1.0004 1.0006 1,0003 1.0003 1.0005 1.0004 0.00013 0.0003 
8 1.0010 1.0016 1.0013 1.0014 1.0012 1.0013 0.00022 0.0006 
9 1.0002 1.0000 0.9998 0.9999 1.0002 1.0000 0.00018 0.0004 
10 1.0018 1.0016 1.0020 1.0019 1.0015 1.0018 0.00021 0.0005 
MF = 1.0004 
5 (MF) = 0.00018 
(MF) — 0.00045 
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a. For set averages: 
1. Central line (CL): 


CL = MF = 1.0004 
2. Upper control limit (UCL): 
MF + H{s(MF)| 
1,0004 + (1.427)(0.00018) 


1.0007 
3. Lower control limit (LCL): 


UCL 


LCL 


MF — H[s(MF)| 
1.0004 - (1.427)(0,00018) 


1.0001 


b. Control limits for the standard deviations of each set are 
as follows: 
1. Central line (CL): 


CL = s(MF) = 0.00018 
2. Upper control limit (UCL): 
J[s(MF)]| 
(2.089) (0.00018) 

= 0.00038 
3. Yower control limit (LCL): 
LCL = 1|s(MF)| 

(0)(0.00018) 
= 0 


c. Control limits for ranges of each set are as follows: 
1. Central line (CL): 


CL = w = 0.00045 
2. Upper control limit (UCL): 


Il 


UCL 


UCL = L[w(MF)| 
(2.114)(0.00045) 
0.00095 


3. Lower control limit (LCL): 


i 


LCL = K[w(MF)| 

= (0)(0.00045) 

= 0 
Control charts for average meter factors and standard devi- 
ations for each set are shown in Figure C-1. Most of the 
meter factors are outside of the Shewhart contro! limits. 
However, the standard deviations of sets are well within 
their control limits. This occurs because variations between 
the average meter factor in each set are substantially greater 
than the variations within each meter factor set. The control 


chart limits shown in Figure C-1 for set averages are not 
appropriate for this example. 


C.3. Shewhart Control Charts for 
Individuals 


Shewhart control charts can also be developed for all indi- 
vidual measurements in a database. Control limits for individ- 
uals are based on the overall average of standard deviations of 
individual measurements in each set. Control chart lines for 
individual meter factors are determined as follows: 


a. Central line (CL): 


CL = MF 
b. Upper control limit (UCL): 


UCL = MF + M[s(MF)| 
c. Lower control limit (LCL): 
LCL = MF — M[s(MF)] 


Since ranges can be used for estimating standard devia- 
tions, the control chart lines can be: 


a. Central line (CL): 


CL = MF 
b. Upper control limit (UCL): 
UCL = MF + Nw(MF)| 
c. Lower control limit (LCL): 
LCL = MF — N|w(MF)| 


The values for the Shewhart conversion factors, M and N, 
are given in Table C-4. 

For the example in Table C-3, the control chart lines 
would be as follows: 


a. Based on standard deviations: 


CL = 1.0004 
UCL = 1,0004 + (3.192) (0.00018) = 1.0010 
LCL = 1.0004 — (3.192) (0.00018) = 0.9998 


b. Based on ranges: 


CL = 1.0004 
UCL = 1,0004 + (1.290) (0.00045) = 1.0010 
LCL = 1.0004 — (1.290) (0.00045) = 0.9998 


The control chart for individuals is shown in Figure C-2. 
The control limits are broader than for the averages shown 
on Figure C-1. However, a substantial number of meter prov- 
ing runs fall outside the control limits because the control 
limits only reflect the statistical variations within sets. The 
variations between sets are not reflected in the control limit 
computations. 
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1.0020 


Average meter factors —— a» 


1.0010 


Average Meter Factor, MF 
8 
So 
o 


a — —j/-— — Upper control limit 
Central line 
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Figure C-1—Examples of Shewhart Control Charts 
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Control charts for individual meter factors can also be 
based on ranges between consecutive values such as the set 
average in Table C-3. Ranges for the example being ana- 
lyzed are given in Table C-5. 


Table C-4—Shewhart Control Chart Factors for 


Individuals 
oe of Conversion Factors for Individuals* 
casurements ——————_—_—_ 
in Set, n Min) Nn) 
2 3.760 2.659 
3 3.385 1.772 
4 3.256 1.457 
5 3.192 1.290 
6 3.153 1.184 
7 3.127 1.109 
8 3.109 1.054 
9 3.095 1.010 
10 3.084 0.975 
11 3.076 0.946 
12 3.069 0.921 
13 3.063 0.899 
14 3.058 0.881 
15 3.054 0.864 
16 3.050 0.849 
17 3.047 0.836 
18 3.044 0.824 
19 3.042 0.813 
20 3.040 0.803 
21 3.038 0.794 
22 3.036 0 785 
23 3.034 0.778 
24 3.033 0.770 
25 3.031 0.763 
Over 25 3.000 3/D(n) 


4B, and Ey are traditional nomenclature for Shewhart conversion factors 
for N and M respectively. 
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The control chart lines based on the ranges between con- 
secutive sets are as follows: 


a. Upper control limit (UCL): 
UCL = MF + [N(2)]|w(MF)| 
= 1.00040 + (2.659)(0.00138) 
= 1.0041 
b. Lower control limit (LCL): 
LCL = MF - [N(2)||w(MF)| 
1.00040 — (2.659)(0.00138) 
0.9967 


A control chart based on the above control limits is shown 
in Figure C-3. In this example, the control limits are broad. 
The standard deviation for the individual set averages 
(MF) with respect to the overall average is 0.0009, and the 
overall range of the individual set averages is 0.0028. The 
control limits for set averages when considered as individual 
measurements are based on the following: 


lt 


a. Standard deviation of the averages of a series of sets: 
Control limits = MF + [m(10)][s(4F)] 

= 1.0004 + (3.084)(0.0009) 
1.0004 + 0.0028 

= 0.9976 and 1.0032 
b. Range of the averages of a series of sets: 
MF + (N(9)|[w(MF)| 
1.0004 + (1.010}(0.0028) 


1.0004 + 0.0028 
0.9976 and 1.0032 


I 


Control limits 
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Figure C-2—Example of Shewhart Control Chart for Individuals 


Table C-5—Moving Ranges of Set Averages for 


Example 
Set =: Ranges Between 
Number Set Averages, MF Consecutive Sets 
1 0.9996 a 
2 1.0012 0.0016 
3 0.9993 0.0019 
4 1.0009 0.0016 
5 1.0005 0.0004 
6 0.9990 0.0015 
7 1.0004 0.0014 
8 1.0013 0.0009 
9 1.0000 0.0013 
10 1.0018 0.0018 
Average 1.00040 0.00138 
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Figure C-3—Example of Shewhart Control Chart for Individuals Using Moving Ranges 
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